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ABSTRACT 


Recent werk with Automatic Speech Reccgnition has 
POcused on applications end productivity considerations in 
meee Man-Macnoine interface. This thesis iS an attempt to see 
ieepraeing users cf such equipment turder timre-induced stress 
has an effect on their pércentase correc’ recognition rates. 
Ssuojects were given a message~handling ttask of fixed length 
end allowed frogressively shorter tilres to atterpt ts 
meerrete lt. GUeESTIONNaire responses inmiicate stress Levels 
increased with decreased time-allowance; reccgnition rates 


aqecreased as tine wes reduced. 
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io INDRODUELLCN 


Stress hes long bpeen an intenseiy ective area of 
mevestigation. More recently, wne itNversecrtion of physiolozy 
meeps yenolcey hes ccncernéd itself with the influence of 
cognitive and emotive factors on quantifiable variables in 
the human organism’s equaticn. This research hes turned ftror 
the most fundarental indices ert human reaction (cardiéc 
rate, electrogalvanic response) to more suovtle measures stch 
Semevaricus features of the human vecice. 

Stress, however defined, Las cleéer and important 
Meerrecations for the conduct of military tpterdtions. In the 
warfere envirorrent, one encounters sore of the few factors 
universally ackncewledged to cause rsychoiogical stress: it 
1s one of the few areas where one Knows arriori thet life- 
threatening situations are consistently found. Thus the 
Peyeno-pnysiological correlates cf mwilitary action eve 
PmiamrenmeaG es cOLD an area Of Inquiry and the raw aata for those 
interested ir the study ot the humar under stress. Swedish 
MereecarCNe rss t00kK an @Garly lead in the investigation ofr 
e¢tress in the military environment. [Rer.1] 

The investigation of any phenomenon requires first and 
Borecw@nre a -beberenL Gelimiting the aré€a of research. Stress 


Bas Yeu UO receive a widely accey;ted definition. Stress 











research tends to divide inte two camps: these interested in 
physiological stress and those pursuing the psychologicel 
Wariety. Both claim the territority of rsychorphysiology. 
Beycnd this, the definition o/ stress breaks dcwn, in the 
[fero, into an examination of either a stirulus or a 
respense: there appears te be no commen egrecund. Cne thing 
which emerges clearly trom puslished research in the area is 
aoa SyYNthetic conception of stress is in order, one bread 
enough to cover the wide (and widening) area of inquiry 
already embarked upon, and which wovld permit breakdown into 
narrower, more specialized areas of interest. 

Given the vagaries of the published resources currently 
available, it is necessery within the context of the present 
mamermeto  WOrK Fitnin adn Operationally-defined, frobler- 
oriented view of stress. From a military commander’s point 
Or view, an ar@€a of great rotential interest is the 
Mmemeeracslion cof stress with voice-input te corputer systers. 
moeemiemeaturizgetion and Expanding technology have rade 
computers a mrore widespread phencrenon in the military 
Environment, the limiting factor (in the military jvst as 
with civilian applications) continues to0 be the hriman 
interface with the ever- expanding base of informatior = and 
aecision aias eveilable. Voice-input to computers provides 
fe T1leCid user With a higher-order interface, at a level 
ebcve even user-triendly query langueges. This type cf 


interface has the potential to facilitate the user’s ability 


1d 





to access and manipulate the vast resources new beccring 
available to him: it is the next logical Step in the 
Mereubion of man-rachine compatability. Computers are now 
adle to handle froblems which not long ago would heve 
abpsorped an enorrous arount of man~hnours, but the man is 
Still in the loop. 

--- though we hail the advent of the postindustrieal 
Seciety, in which substantially all our essential human 
needs will be ctreduced without a great amrourt of kuman 
effort, tke fect remains that the rilleniur is net here 
mae nurdan beings ar€ rot yet orsolescent as irrportant 
women reuters to the preductive prcecess. The quality cf 
rerfermance ty mé€n and women, whether in mranufactvring 
Or servicing, still accounts for a very larze part in 


the variation in preductivity, however cne cheeses toa 
define the criteria of productivity ~- and this condition 


oo 


Will continue to prevail tar into the tuture. {[Ret. 2: 
Deena li 
Automatic Speech Recognition (ASR) is a dé€ronstrated, 
Omeline technology of clear interest to the military 
commander. (For a discussion of the range of voice input 
applications, the reader is reterred to Reterences [2] and 
[4]) The rapiaity with which current data fprocessing and 
computer netwcrks now operate necessarily imply thet the 
machinery spends an inordinate part of its time waiting ‘cr 
input fror the humén opé€retor. Speeding up this espect of 
the intertace, a quantum lear in user-accorodation, is one 
of the major contributions to be expected (and even now 
available) trom speech recognizers Linking the huran to. the 
computer. Speech reccgnitcn systems, while they generally do 


not affect the internal workines of the computer, fpresent 


Jail 





moeir greatest potential advantage in iucreasing the 
efficiency of the total human/machine syster. Industry was 
Gu.cke to reccenize Perse POLGMt lame. VOICE input systems are 
presently in use in various sortirg eéane assembly~line 
applications. 

Computer input by voice presents several advantages in 
the military context, especislly in the Cormand Fost 
environment. It ‘trees operators’ hands to enable other 
concurrent tasks, such as transcription or raniprlation of 
Other equipment, increasing froductivity in both areas.[Rer. 
S$} Just as imrpertantly, it proviaes the potential fcr the 
Meee -OTelalOr tO maintain a graphic or figurative ylsot of a 
Situation he may be monitoring at the terminal. This wereld 
gemmoweOUrcTS nOtL familiar or comfortatle with the computer 
tO comprehend and tollcw what the operetor may see unfolding 
at his work Station, without requiring lengthy and 
fmeneetening eCxtlanmations tror the operator. Voice-inrrt 
could enable the ocperetor to continue his task at the 
Germinal and Simultaneously fanieulare a visuéi 
representation of the problem he is invclyved in, for others’ 
benefit. Picme ised PpOtentia! boon in the period of 
transition trem a symbolic gestalt tc an era ctf mtch mere 
widespread computer literacy. 

WOrTeOver , Cov 117. ive psycnology has Pp Resented a 
Scieneizic mcedel Tor LéESk Slmeeaorr ivy to di Pierent 


WOdalities which takes the criteria ftcr task asSignrent far 


ve 





beyond the cbvious basis ct ease . Sandry and Wickens [Rer. 
E: pp-8-12] have proposed the concept of  ideorotor 
compatability : human input/output modes may be matchéd to 
the senses ard hemispheres cf the brain which mest readily 
process ther. Quicker, mrore accurate responses result when 
responses are matched to stimuli (such as hearing and 
Speeking). Short term memory for verbal informetion is 
Sienificantly inrroved when that information is presented 
auditorily. 

There ere cbvious correlates of ideorotor compatability 
in a situation such as a Command Fest. The comrander gives 
an operator verbal instructions regerding a task, and this 
Operator then ex@cutes these with voice inrut to a terrinal. 
In competing fcr the humen operatcr’s mertal resources, it 
is Sandry and Wickens” thesis that no time-sharing decremen? 
results when competing tasks are ideomotor compatible. 

The automated resources available to the conmander in 
cme current envircnment are expanding and gaining 
increasingly widespread accéettance. The applicebilityvy of 
yoice PNET TO computer Systers is therefore beth 
intuitively and logically attractive, and has been sairing 
increasing attention. Stress, however defined, is 
universally ccencedéed tc be a factecr in the ner side cf 
bats) equctienm, amd therefore tc has irplications cf rilitary 


interest in tne cormand and control environrent. 





Given these ccnsiderations, what then might ere _ the 
effect of stress on an operatcr of a voice input system? In 
varicus areas, research cn psycholcgical stress abcunds, and 
researchers are now turning their attentions specifically to 
the effects of stress on the veice. The pubdlished research 
in this latter aree is, in the main, inconclusive. It is The 
Meee, Of this tnesis to see if sore relétionship Exists 
between stress incident cna Voice-input operator and his 
Success rete with an automatic sreech recognizer. It is to 
Bemeempnasized thet Virtually no werk has been nublisned in 
this particular areé. ThE current study proposes itself as a 
meeeliminary inquiry into a Poe woOmeron Ot pétential 
Significance, and cne which has as yet received Little 


Experimentel attention. 
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ie eee BCCGNITICN AND STRISS 


A. DEFINITION 

Central to any study of the interaction cf stress ard 
Mmmemmourrub Of Voice recoenizers is a definition of what is 
Meamimenunderstced py <stress . SS stated (ct. supra}, the 
Meee reement in defining stress 1¢ so tuncamenteal thet @ver 
Mmeeent twreattrerts adizter in clessing stress as stimulus er 
response. In céertéin areés, fpowever, consensus enmer¢ges. 

Mmmre=celpetee [hysidicegical sexse is more clear-cut than 
Mme sycoOlcgicail. Pkysiolcgists rey refer unambiguously to 
Memes Ure>sOLS Such aS aEat, =ressure, electric shock, ana 
Mmeebine, in tne wey cf Stimuli. The resultant reéctions are 
SeesoOerererlrea tO as Stress, «nc are mweasuré€d in carcl1o- 
pulmcnery Lerereters, Eupilt aGliiéeticn, end similer observeole 
SelmeeatiLitlapi€ Lhen.omena. When speaking of physiological 
umes, «6 SUiTIiceS Co Specizty whether stirvlus cr response 
is meant. Many stressor-2zents Lave deen extensively 
epee amecOtn in this cOuntry aud abroad for their military 
impects. 

Piewemoweadied) 15 =Ntereac wlth esycholovical stress and 
its causé€s or manitestatiors. Verious researchers detine 
Stress as the orgenisr’s reaction (coring or adaptive) tec an 
untriendly environnent. Others aetine stress as the inimical 
Pie Wemee Ot ethe EnVIiPTOn@ment On the irdividual. In recent 


uUsSaze, Eaie POerer  GetTImiTica  aptrears t0 have gained 












ascendancy over the latter, although the adebete is far from 
pepcied. 

me 6 6CPS tere tre 6lncumbent6«6©6tc)6]366udefine pay choieezical 
“stress before proceeding further. The definiton must te 
Surticicntiy troaa tO Span a wide gamut of potential 
poeremena, and taus preserve meaingyulness. In addition, it 
must be sutficiently werrow to be useful and workable within 
the mecessdrilly mirrored seope cf this Experiment. A 
synthetic deriniticn or stress will here mean ‘the arousal 
Omeoercec Witkin tne individval ty unwelccme stimulus cr 
threat. This ig tte cperational definition which will be 
meer ea 1) 2a aAtLGr pt tO CxaM@ine toe end-ertfect of producing 
this type cf arosai in subjects interacting with an 
Gumenavlc Steech recognizer. 

moore 25 @Cxtensive literature on the subject C= 
papemoLog il cal Etres>S (@ueh of which falls wlthin the 
detirnrition avcve; and its ccrrelates, especially the 
physiologicel correlates. Tne Navy has done Extensive work 
in the fieid, mcst notably in Sar Diege. [Ret. 6] 
Peycholog@icel Stress may be further oroken down into 
interesting subcategories. ) Situetional stress is 
gererally heid tc be the intluence on the individual cf 
unfavorable environmental (out non-physical) factors. These 
tactors are peyond the individual’s contrcl and are 
PEenerem sw toor-ht tO consist of & Corte im Set of 


Circumstaaces such as fublic speaking, dé€adlines, and the 


ie 





lize. <) Sel*t~-induced stress is generally reccgnized as the 
self-imposition or a condition or stimulus leading to the 
Mere Of arcusal déefineaq above. Examples include goals, 
aqéaaqalines, or performance requirements of any type with 
Beemora, tne individuel torces himself to ttnction atove a4 
“comtortacle cr easy level. 

Thesé distinctions often merge, however. In a prime 
example, Swedish military pilots were giver a relatively 
complex set of procedures to execute in an unsophisticated 
Pie ht Sifuletore ana Emomised a reward toOr igh 
pertcrmance. [Ret. 7] The situation was imposed on them, 
and cculd pe construea as Situational stress. The desire to 
pertcrm ata aAigh level, Lewever, was self-induced. Ar 
mLeresting Outcore of tee Experiment was that the 
Physicltcgical indicatcre of the pilcts in yqueéstion reacted 
renarkadDly like those or pilots in a Similar non-Simulated 
Sereueroon. A turther interpretation otf these studies was 
meee subjects had come to accept the reality of the 
Sirulaté€d situations, and their BEhysiologicaL indicators 
retlected as much. Stich studies, in general, tend to support 
the velidity of Simulated Situetions in conducting stress 


research. 


feo Stewoo AND TER VOICs.- 
Deempivertoe abuldance ot general stress literature, 


relatively Little Las veen done on how this phercmenon might 


1% 





manifest itselt in the human voice. Hicks [Ref. €] gives a 
magmentivul OVeErvView OY Utne recent literature, in addition to 
his own experimental results with various forme of stress 
and voice. HE ccncedes the generally acceptea rotion that 
stress has an influence on individuals’ fundanental speaking 
frequency (to); he Porcdde= (as do others) that this 
parameter is as likely to 20 UP 4S down, with “concomitant 
frequency-range veriations. The magnitude and direction cf 
THis SHitt in $0 is a function of the individual speaker. 
Perbickally, the emovnt of shift required to constitute én 
imdqgication of stress is still a sutjective assessment. The 
cné cenciusive result, repcortea by Hicks and otners [Ref. &: 
jmeeye o.lZ@4] 1s that the ratio of speaking time to total 
Time will increase ina stressed speaker. This is consistent 
with everyday experience: stressed speakers often appear 
to talk in longer obursts, with shcrter pauses separating 
them. FaréemetersS other than the spéeech-to-pause ratio give 
maconciusive or coxrtested resuits. 

A large amount of commerciél interest has focused on the 
Perec tee SOE SUTESS ON VOCal parameters. One can iragine the 
potentiel interest ir being able to evaluate the stress 
level ot a speaker. If done by voice, this analysis could be 
pertormed at great distences (vie telephore, radio, etc.) 
and without the sreaker’s knowledge. Several firms have 
MaTKRe@ReEdeadevViceS purported to analyze the stress level of 


Speexers (as a sort of voice polygraph), but their claims 


1& 





eemear SLUEJECct to debate and are hotly contested in 


@rercies. 


acadéric 


These devices base their analysis cn the existence 


feeermerotremor in the muscles controlling vocal activity, a 


Phenomenon which refrains to be 
rere | 
merever, 


Peguires rather 


Variations so tar denonstrated have snown 4& 


Lature: where cne sudject’s 
€tc. Thus, anaiysis of a speech 
Sere auc Ove Knowledge On 


tTenaencies. Analytic efforts so 
necessity 


underwey both to osjectify suck 


1 
analytical algorithms invcived. 


mo 6 SHCrt, there 


conucius1ve 
vwiaely 
Oomevoeal! Troduction, ye€t 
industrial 
In 4 


ss 


filitary/applications 


PaeeroSt trurtiul area OF inquiry would be the 


GreeStress Upon the volce, 


The r€@aaout froviaed ty voice stress 


CWiicerMme IMnVTeEnpreteticn. As noted, 


MOberderer SUDJECTIVEe analysis. 


Cue ety 


A€ccepted that psychological stress has 


Circles what the best indicaticn of 


from the 


chown conclusively. [Rer. 9: 
analyzers 
vocal 


Subject—-spe@eirik 


bho rises, encther’s may fall, 


Sdigee tOr. Stress Requires 


the individual speaxer’s 


far pave veen limited by the 
Werx 15 cUuMpmentiy 


enalysis dnd irprewe the 


ao universal and few 


indicators ot stress in a speaker's voice. It is 


én influence 


hotiy contested in academic and 


stich stress 


CONTEMt pMitwray weil be thet 
ifbiicatlons 


Veewpomnt of productivity 


afid reliatility with a@tutonatic speech recognizers. 


+ conversetions Wee tebe BleneS, University of vayton, 


Cctober i¥Ee2. 
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II1. EXPERIMENTAL COMECNENTS 


A. GENERAL 

It is generally recognized to be important to simulate 
Doan CxXperiment tne conditions unaer which the pheromena of 
interest right actUvally be expected te occur. This is ne 
Meow incOrtent in experiments dealing witk voice input, 
Bere unere is a clearly definable task and one suspects an 
Operetive pUT unquentifianle Pecmor Such as Stress. 
memeeover, With volce inrut, it 15 essential to use subjects 
representative of those who might actually ve using ASE in 


the task-envircrrent at interest. 


maetiiex Clr VOLUNTCCr sutjects were cbtained, mainly 
meaomeerne Cl Curriculum at the Nayal Fostg@reauate school. The 


makeup of the sampie is snown below: 


Tandle 1 
SUBJECT DEMOGRAPHICS 


EXPERISNCEL INEAFERIENCHED 


toe ee teem er ee eee + 
MALE MILITARY Yy @ 
tert er meer ee $e ee ee ee eee + 
FEMALE MILITARY ez | 1 
toe ee + mm ee “. 
Pee, CIVILIAN ! Q ! 1 
+ eee ee He tee eee ee + 
FEMALE CIVILIAN ! Y 2 
ee a = = 
TClane lz 12 


a’ 





muy ONE Of These Subjects were military officers, in. the 
eradé cf QOS and 04, representing the four services; three 
wueeminor Civilian agencies. Six cr the twenty-four were 
fenale. These subjects were ata level in their careers 
Deere, cSpecicily in light of their CS beckground, they 
Mment r€ascnebly expect 1G be at the mid- tc upper levels cf 
emeommand-Fcst statt. In short, they were trire ceéendidates 
Pees i fe Voice input in a Comménd-Fost scenaric. 
Seeeeveminecu7,-10ur, ali Had some trior @€xperience with 
Hom, which was defined for the purpeses of the experiment as 
Peeercripdtion in  tnree or more Cx periments at Ene 
Postgraduate Schcecl, tne cthers had none. The sexes were 
evenly aivicea vetween the two groups. Batchellor [Ref. 18] 
memoemmon Statistically Significant difference in recognition 
rates betweer sexes with the particular recognizer teing 
uséc. The talanced sample (tlocked on sex) was usea 
Mometnmeless to contrel ror any untcreseen errects due te 


gender. 


Ge VCCABULARY 

Te ore DIMeEnt ys Subjects trained 4 fifty word 
vocabulary (Appenaix A) which aincludead some numerals and 
Varicus other utterances. The vecabulary wes chosen with a 


Specific turpese in smind. It has veen shown [Retr.1¢] that 











Meee CGeTreCC201G10n ¢€l a word or phrase 15 directly related 
vo «6the)«6Ch Length )6 6of the utterance. Io this light, some words 
were deliterately chesen over others te aveid contusion or 
vossible misrecegnition. (For exemple send messege in lieu 
of the shorter send.) Gther words were cmitted for the 
See reasons. Sore of the vyocabdulary iters were useéa 
Mmeeeeguentiy, tut were n@écessSary icr the task. [n sum, the 
vocabulary chosen wés the minimum felt necessary to enable 
Gepost n= ShOrt messages with a fodicumr of realism and some 


mer,ely. 


Macm subject nas given a scenario cecnsisting oF 2¢¢ 
utteracces (Appendix B), with each wora or fhrase numbered. 
7NESEe utterances, when correctly interpreted oY the 
recognizer, brovght up on the Screen an Output resembling 
messages which might be s@€nt or serviced by a shiptoeéra 
Command Fost. (The ouput trom these message sequences is 
Smeyn in the rient—-hand column ot Aprerdix BE, which was not 
iPeeGecmm LO Caeperiment participants; for examples cf the 
types of messages see Figure 1.) Certain utterances proauced 
a multiplesword OUTE UL, Simulating message-handling 
utilities such é&s are resident on the ARPAN?ET, with which 
See SUD jects Were tfamillar. Verisimlilitude was an important 


consideration in the aeSign of the task: 








SAMPLE MESSAGE CUTFUT 


SEND MSG TO:/ CV BATTLE GRCUF / COMMANDER 
mirc CCPY YO: / COMTHIRDELZST / CINCPACFLEFT 
FROM: / USS RATHBURNE 

PCSITICN / REPORT / NUMBER / 1 

READINESS LVL / 2 

FOSSIBIE / ELECTRONIC / SURFACE / CONTACT 
BEARING: / 1/8/8 / DISTANCE / 2/7 

CCNFIDENCE LVL/ 3 

REQUEST / INSTRUCTIONS 


CUIT./ 


FCRWARD MSG #: / 7 
INFO CCPY TO: / CV BATTLE GROUP / COMMANDER 
FRCM: / USS RATHEURNE 


Gort. / 


(NB: The symbol / indicates the separation 
between utterances. Line separation is 
accomplished by speaking RETURN which 
yielas a carriage return.) 


Figure 1 


SAMPLE MESSAGE CUTFUT 





lee pOLnt Of departume Of the synthetic-work approach is 
a behavioral analysis ctr the pertcrmance requirements 
placed on the operator by some specific system, or by @¢e 
class of such systems in general. ‘Tasks are then 
“selected against a criterion ct cortent validity (i.e., 
tasks are selected pnecause they measure functions judged 
by exyerts in the tield to te important to Lhe 
operaticnal situation ct interest). A general criterion 
force vclidityais eiso imposed (i.e., tne tasks are 
centigurea tc be acceyltable to target populations, ¢€.g., 
Beelots ... [Rer.11: pp. 22-23] 

Subjects were to speak the utterances in order, Each one 
meee tHe «€6Dprcrer€6(outTpUuL)]«60appeared cn their screen. Fach 
eeecuevyesS given the same scenario three times in the 
course c* the experimert, with at least one day (tut ne more 
than two) tetween reprises. Cn subsequent trials, subjects 
Were  teld that tne scenario tney were given was of exactly 
the same length and of similar ccntent to the one(s) they 
haa s€en previously. The same sc@nario was used rereatedly 
POwcomtrol for variability of the task, and it was felt that 
meee scenario was of sufficient iength and variation to 


negete any sigriticant learning effect. 


ee ite oincos FACTOR 

During the tirst phase ot the experiment (Phase 1), 
Subjects were allowed to complete the scenario at their own 
Peee,. end were EXNOrted nOt to rusnd or needlessly tinger. 
‘cf. Appendix C). The experimenter attempted to put them at 
ease. Unknown to the subjects, they were being timed, ana 


their times to ccmplete the scenaric reécoraed. This time was 
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Demeserve aS an individual beseline against which subsequent 
phases would be timed. In the next phases (Fhases Z ard ¢&) 
Smeeeects were allotted two-thirds and then one-third ct 
Meeer Daseline times, respectively, tc attempt to ccmplete 
the Sscé€nario. It wes anticipated that not éll svojects 
would complete whe scenario under the shortened tire 
eemeemance. SUCTiIng waS aajusted to reflect the amount cf the 
task actually completea. (ct. IV.B infra) 

The time-cortression was intended to induce stress in 
mee SUCjJECtS. Tney were intformea at the outset of how much 
time they wculd have to ccomplete a task witn which they were 
elready farmilier. A lerge Gra-Lat darkroom tiner was plainly 
fee if irent of the subjects to sncw time remaining. 
Additionally, the experimenter reringed the subjects 
Meee ventiy at tUtairty-second intervals of Uheir tire 
remaining. Subjects could gvage their own prcegress in the 
coo iter scé€nerio. Apriori, it was felt thet the two-thiras 
time would constraing some out not all subjects; it was 
reesonadly certain that allowing only cne-thirad of the 
Serre cme WOuld do so. This OpWaion seered to pve borne 
out in pilot triéls (with subjects not usea in the later 


experiment). 


kt. EQUIFMENT AND SETUP 
The voice recognition syster employed was the TE 


reccgnizer manufactured by Threshcid Technology, Inc. (See 


iS 
Leo 





bigure < fOr & plock diagram of the system.) This is a 
discrete utterance analyzer, wnich analyzes samples oft 
speech up to a raximum of two seconds in length, séparated 
by a distinct ypéuse cf at least one-tenth of a second. 
Utterances ct rore thar cone word are allowed, as long as tne 
words aré€ run together and pronouncea naturally , without 
Meee ect Creaks between them. 

The TE@~ nas a maximum capacity cf <56 utterances. In 
Mees training wede, the subject repeats a werd or phrase ten 
times. (Under certéin circumstances, fewer repetitions mey 
be use€d, tut this requires moaiticeéetion of the sortware and 
yields Less censistent results [Rer. 1¢]}. After the tenth 
Meeeertici, the tem are superinposea and yxnorralizéed in 
peer tk to ferm a tetplate for trat utterance. LUE. «0 Cols 
Smeerin6fent, a itraining standardization measure was adofpted. 
Meese SUD JECtS Sad Tinished traliding, they repeated the 
MOGeovlary 11st in t0to at leest twices any items not 
Memerectly LTECOZNLZEd On at LEafSt two of three passes were 
retréined. 

When the user speaks, his speech sample 18S comfareéc 
Pers ede CHeESE templaves=tcr the best matcn. If within 
preset tolerances, tne utterance is recognized (correctly or 
not) and the output string sent to the display screen. If ne 
match 1§ founa, tae machine produces an audible beep . Each 
Pireviclaleemay stcre nis voice template ona data-tape 


forename wer estuture use, and thus tyzpess the lengtay 


nN) 
O) 





MICROPHONE 


Say! 
Lo : 
PROCESSCR }--—------—>TEFRMINAL 1/0 
/ A ie 
| 
| | 
j { 
| ] 
| | 
sa an Snape et Be | 
| 
| 
' TAPE CARTRIDGE UNIT !---! 
| | 
| | 
wonton nn 
| 
j 
| 
Ofer 
CRT/KEYBCARD 
| | 
| | 
Figure < 


TES@O/CRT SET-UP BLOCK CIAGRAM 


ain 





training Process in future sessicns. Each utterance is 
programmed by the user (in this case, the experimenter) with 
a prompt for training. When that uttérance is cued at the 
keyboard, the fLromrpt-string appears on the aisplay; it 
disappears after the tentno repetition. Atter training, the 
recognizer shifts t0O the recogniton meade end awaits versal 
Meee. WHNED utteratces are recognized, an associated 
prepregrammed output string is sent to the display screen. 
Tne output string corresponding to an utterance is wuser- 
selected, allowladg up tc a maximum of sixteen alphanumeric 
CmeretCters. 

when used in cooOjunction with a computer, the TEC may 
be used in either direct or buffered modes. Direct sends 
Ee CUusuummSDrine ©O TIG scomputer without delay. The 
“Buffered mode allows the user to verify the output before 
Seow)! ial LOmpemS@ml. lhe durecteapode was usead here. I[n 
this Experiment, the TE€@0 was used in a stand-alcne 
Paectul lacus lnese were SCLT to the display screen and 
ncwhere else. (Fer turther discussion see [Ret. 12] ) 

Tae Wicrorphcerne used was @ Shure S519 noise cancelling 
Plt. iceman DY all Swbyects on the lett side oc? the 
head, directly below and Slightly to the left of center of 
the lips. Tec *urther attenvate echcec and outside noise, the 
experiment was conducted inside an Industrial Acoustics 
Company scundfrooct chamber. (See Figure 3 for the actual 


equipment setur). 





Figure 35 
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IV. EXPERIMENTAL DESIGN 


A. OBJECTIVE 

The primary objective was to see it time stress aftected 
users” recognition rates with this voice reccgnuiticn setup. 
after the initial training s€ssion, (and after a delay of 
three to ‘four days) subjects tegan the pcriviion cf the 
Experiment which irvolved the scenerio. They were fitted 
With tné€ ficrorphone and hancec the scenario. For each 
respective phese, they were reéa the instructions in 
Aprenaices C,), ana FE. The intention was to induce stress in 
SeeeyectsS in the jiest twe pkases cf the experiment by 
feeoeressively shortening the tire allowed to perform a task 
of tixed length. Compression cf tire allowed was tc 0be 
COrretlateaq with percent correct reccgnition rate. 

It was neoped that several tactors were to ce at werk on 
The participants. There was a definite competition for the 
SupjectsS meatal resources. Subjects haa to read @ word or 
Meeeeee irom their printed scenarics, speak it, and verity 
toat it atpeared correctly on their screen. If misSrecognized 
cr veepecd , they were to try again until correctly 
recommmeced@s The experimenter instructed subjects to proceed 
tO the next scenaric item if they had tive unsuccessfvrl 
attempts, although they haa no foreknowledge of this. This 


was yet another factor in the stress equation: failure at a 





tase is in itself stressful for most individvals.[Ref. 13: 
Peers t | 

At the cutset cf @ach of the last two (time-constrained) 
meses Of the experimrent, subjects were informed of how much 
time they would be allotted to perform the scenario. After 
Mmoens Seccrd and before the last phase, many indicated to the 
experimenter that they knew they would have less time than 
in the previous session. This suspicion was desired end was 
calculeted to create a measure cr negative anticipation in 
Gee participarts. During the last two pnases of the 
Meeetirent, Suojects weré€ reminceéd insistently by the 
experimenter of time remaining, in acdition to the presence 
of the highly visible timer. It was eEStimréeted that this 
corbirnation of factors would indvce stress: 


The apprehension of psychological stressors iS a much 


rore complex business. It depends on: (1) frior 
experience with a class of stresscrs; (2) remembering 
Tne experience; (3) récognizing that the present 


Stimulus gestalt is an instance cf the earlier class of 
stresscrs; and 14} believing tnat the likelihocd ot the 
threateénea CCCUTTENCE is abcve sore subjective 
Memesnnola. [Rer. 13: ~. 142] i 


Moreover, 


While the exyerinental manipulation allows a tairly high 
aqegree ct contrcl over the stimulus conditions, the 
réaction patterns of subjects are often aifficult to 
Mememmines ... inus, them stress level imducea may be 
minimal for some subjects, whereas it may be moderate or 
Pomm@er StUrone ft0r Others. Since it is often aifficult to 
determine a definite External criterion for stress (even 
psychophysiolcgical variatles cannct always be expected 
to indicate the stress level of an individual 
consistenuly and validly,) experinenters using 
ijaboratory stress induction can cnly hope that they have 
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been arle tc inauce a reasonable amount of stress in 
maeir subjects. {Ref. 9: £. 176] 
The fundamental nypothesis being tested her€ may de 


summed up as: 


He: Time stress has no effect on the recognition 


Tates Of users of VOICE Tecognition systems. 


Hi: Tire stress affects the recognition rates of 


users of volce recogpition systems. 


Pert onally, it was Ecpea to see whether: 


BC: #xreriencea and inexperienced users of voice recognition 


systems are affected equally by time stress. 


Hl: Exyerienced and inexperienced users of voice recognition 


Peron ssoneehot atrectede equally oy time sfmess. 


meen SCORING 

Pee ee ve arere TONLItcred during their performance of the 
Soro mone Gk PerTImenmter sat to the right of and behind 
suojects (ct. Figure 3) from which position both the 
subjects actions and the aispléy screen weré clearly 
Visible. wMisreccgnitions (improper word subdstituticns by the 
recognizer) ard non-recognitions were recoraed. A confusion 


Matrix of substitutions and ‘beeps is included as Appendix 


OK 








fF. Subjects occasionally lost their place in the scenéerio, 
Pereating some vocebulary items they had already spoken. 
These repetitions were counted as additional utterances, and 
the correct or incorrect result recorded; thus, no penalty 
wes given for repetition. The caveat in the instructions 
@eeun penalties ror non-completion of the scenario was 
cogus. It was added to provide ar additicnal incentive tc 
finish, and in tne hope of ré@inforcing the subjects’ 
apprehensicn. (Subjects ccompleted an average of fifty-three 
Mewceot ot tne sc@nario in Fhase 35; none finished.) 
neccgnition rates were cased on tne items c* the scenario 
ectuelly completed. Percentage correct recognition was 
fone CC ed as cue GuoOTLIELt Weaeeuiee number Of. correct 
reccgnritions divided oy the total number of utterances 
Spoken by the SsuD JECTS (including ris- and non- 
recognitions). 

At the end of each phése of the expérirent, subjects 
were asxed to rate their teelings during that phase. (See 
questionnaire, Appendix G). Five surrogate descriptors were 
us@d tO circumscribe the idea ot “stressed 3; subjects were 


asked if they felt: 


1. nervous 
<.- confused 


es. pressured 





4. irritated 


ee abprious 


mumecescale€ Of one to five, five being the highest level of 
Each. It was thougrt thet these individuel response levels 


mignt somehow te related tO recognitlon rates. 


G. CONC&FIUAL DLESIGN GF THE EXPERIMENT 

The aesign employed was a two-factor mixed design with 
repeated measures On one factor. [Ref. 14: pp. £4-61] 
Alternatively (and tor purposes cr clarity) the design might 
be tAovUEent of as involving two conditions 
(experiencea/inexperienced) and three treatments. (See 
Figure 4 for a graphic interpretétion). 

As stated previously, the treatments consisted Of three 
Variations ot time in the testing, constituting the three 


phases (excluaing the training phase). 


1. Phase i caseline tire: nce constralnt 
<. Phase 2 z/<z baseline time 
z. Frase 3 1/E paseline time 


These phases were conducted in the oraer shown. While it 
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Figure 4 


CONCEPTUAL DESIGN OF THE EXPERIMENT 
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might be thought preferable in the classical design of 
experiments to randomize the sarinistration of the time 
constrained portions, this was not done, Randomization 
might have controlled for the possible effects of learning’ 
between Fhases 2 and 4; this benetit was consciously 
sacriticed in order to introduce the apprehension factor 
Geeocussed above. It was suspected apricri that the drastic 
time compressicn from the second te the third phase of the 
Egcperiment woula help t0 compensete fcr the pesescldlec 
confcunding introauced by oan eo Mereower, the scenario 
was felt to be long and vari€d enovgkr to counteract learning 
in some measure, io adaition to the experinenter’s deception 
that successive scenarios weré not exactly the same. The 
Tact that all phases were sefareted by no less than 4 day 


,ana no mere than twe}) was alse felt to counteract learning. 


Cie 








V. RESULTS AND ANALYSIS 


A. ANALYSIS 

The results ot the experiment as described are shown 
graphically in Figure &. Betvore ccnducting any analysis, 
Hartley s test tor equality ot variance was performed on the 
raw data. The resvlts indicated that equality cf variance 
WaS an invelid asSumption, and thus the raw data required 
transtormation: after arcsin transtormation, the @quality ofr 
variances was accepted. (See Figure €) 

The anaiysis ot Variance table is presented in Figure 7. 
memeers réedaaclily apparent from the graph of the raw data, 


Meemeemition rates for the experienced group aqecrease 


mooetcnically with time ccmpressicn. This is alse true fer 


bz4 


Phases < ana © of the inexperienced ¢eroup. The Statistic 
chows a Signiticant ditrerence between trials. Theretcre, 
Mmemnoull nypothesis of time stress not affecting recognition 
Maeve 15 rejectea. 

An interesting phenomenon is observed with tne 
inexperienced grour, however. From Fhese 1 to Phase < their 
success rate increases noticeably, despite the décreased 
Gime allotted for the task. This is hypothesized to be the 
result of a ccnodination ot tactors, the most obvious of 
Which is learning. From their first, open-ended trial to 


Pvewcccoma, tne INexperlienced -~roup became rore adept at the 


task. Mcreover, given their relative naivete with the 
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SUMMARY OF EXPERIMENTAL RESULTS 


— Pp GP a aD ee ee a ee ae Se eae Se Cb 2p ee C2 ee SD SP ae ew ee SE == C= 6 ap == 


RAW DATA 
(For percentages, multiply by 1982) 

— % 

X Se 
Phase 1 29s9 OUeo 
EXPERIENCED riage 2 947 9212 
Phase. 3 .€97 2241 
Fhase l Nate 2081 
INEXPERIENCED Fhase 2 941 OGz2e 
Phase 3$ 912 ~2E37 


Mera td=t=C and dfz2=(r-1)=i1, 
Fartley’s test, Frax = 6.22 (alrha=.¢ 
For the untransforred data: 


cn 


Srax/Stin = .90€1/.0012 = €.7§ 
Mmerezsore, reject equality cf vearlances; transform data. 
After the transfcrmation (y = 2(aresinVx )): 

Smax/Smin = .¢428/.¢121 = 3.837 


Accept equality of variances. 


Figure 6 


CATA SUMMARY AND HARTLEY’S TEST 








SOURCE oD df 
Total 4.292 fas 
Ee€tween 
Subjects 2.074 ZO 
Experience CE4E 1 
mrror (bb) 2.041 pe 
within 
Swb jects esl 48 
Time Factor 6242 2 
TimexExperience .z21€ Z 
Srror (w) Taew2 44 
Figure 7 


ANALYSIS OF VARIANCE 
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equipment SELUE and the task, inexperienced subjects took 
meteer tO complete the initiel Ehase of the experiment and 
tous had a longer baseline (an average of 7.&%S minutes, 
versus €.4& tor the experienced). In the Linear compression 
ct Phases < and 5, they simply had more time than the 
experienced grcuer. 

It was 20t kncwn apriori if allowing two-thirds of 
Daseline time in the second phase woulda impose a felt tire- 
coustreint on all subjects. For this reason, one-third was 
chesen for the *inal phase: althcugh seemingly impossitle, 
Moevas  telt thet such a drastic tire reduction would induce 
[eress 19 the majority cz the sutjects. Such appears tc be 
the cese. Exzperiencead subjects show a aeclineé in each 
Eeie@e@esslivVe phase cv the experiment. I[nexperiencea subjects, 
mummers) tHoeCreticaily still on the upward side or tnéir 
“Learning curve show a proncunced decline “rom Phase 2 te 
Biase c. 

For tne inexperienced group, both the rapidity cf the 
learning effect and the quickness with which it was negetea 
have additional significance. A Newran-Keuts range test 
‘alphe = .25) wes performed tor ditfererces in the meens 
amongst foases Of the expérimrent. [Ret. 16: pr. S&-27] 
Phases 1 and < were seé€n to ove Significantly different from 
Phase 5, tut were not alittferentiable between themselves: 
this 1S obviously aue to the inexperienced grovp starting at 


a lower rate, then coring up to meet the experlencea grour’s 
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mean sccreé. &A two-sample "t-test shows a dittference between 
the experienced era inexperienced groups only in the first 
phase. (At an alpha critical of .¢69). In subsequent phases 
Of the exzperirnent, the two grovrs are Statistically 
Meeestinguishatie. This is turthner contirmed by the F 
Statistic for experience in the analysis of variance. The 
inference to be drawn from this appears to be that tne 
eee os Ct learning ch this type cf Equipment are so rapid 


és tO Méke the two groups quickly very similar. 


ge. CORRELATION 

rirst, an ettempt was made to correlate subdjects’ 
fmeatbonicire responses with tng phase ot the experiment tc 
Whicre they were resperding. It was desired to see if 
meeeosse levels were soWencw dependent on the tire stress 
mever> imposes or the participants. It so, a pesitive 
Coeere tion wpculd show @a@ rising response level to one or 
Meee Fos ime tive cuesticns as time compressicn increased 
SetD EXPeErTirent phese. The data to be ccrrelétéea were 
nominal (phase), versus crdinal (1 to & cn guestionnaires) 50 
tne ncnparametric Spearman’s Rho was used. [Ref. 17: Ep. 


252-256] Table 2 shows the results: 


42 





Taole < 


Correlation ot Questions with Phase 


QUESTION RHO 
1. nervous cc4 * 
2. Coneus ed eoue 
Oo. pressurea wee eu 
4. irritated Be aia" 
oO. antows £08 * 


(* indicates significant at alpha less than .25) 


Thus, three of the tive questions shew a strong correlétion 
With the time compressicr with phase. Moreover, these turee 
Farticular agescrirtors (nervous, pressured, and anxious) 
MememetoCUeht tG be tne closest surrogates of the vive tc 
OUperwise vescribe the situational or time stress desired. 
(Tne otner twe show a0 correlaticn.) It appears that the 
Experimentei conditions were Successful in inducing stress 
1n sone measure. Mean response rates for subjects” answers 
ere Shown in bigures €-1z. 

NEXT, an attempt was made to correlate subjects~ 
Guestionnaire responses (on the five descriptors elready 
Rentionea) to their recognition rates with the syster. It 
Meso USECCLEa Lerorehand thet respcnse levels tc one or more 


Of (tNeSe Questions mig. increase monotonically from one 
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RESFONSE LEVELS TC CUESTICN 1, NERVCUS 


44 





Gr 
c. 


nN 
cr 


| Se eS See ] 


ee Aree er 


{ ---—--- 


— ee ee ee ee 


Mad 


ha OEONSE 





-_ Pu =f Pi coal a 
rx =RIEN aw 


nae * ts cam 5 ue Ae ‘es 5 
Lite Pse JE OR es BF 


~ —_—— ee a ee > a ee ee oom ——- oe ee ee ee ee eee ee ee —_— = a ee eee ae ae 


bigure Y 


Mawes MRO Gest ICh <, CoNFLS20 


if 
CF 





cn 






| 
| 
1 
| 
| 
| 
| 
| 
| 
| 
A om 
| 
| 
| 
| 
| 
WXPERIENCED 
| / 
| 
| 
; — — INFXPFERIENCED 
| 
| 
| 
| 
| 
1 
: / 
| 7 
| 
J 
( 
| 
| 
| 
| 
| 
J 
| 
j 
| 
| 
| 
| 
| 
| 
| 
| 
| 
| 
t 
| 
| 
j 
| 
} 
.f ---------- a pe Pr per ee a cs 
Phase l Phase 2 Phase 3 


kigure 12 
MEAN RESFCNSE LEVELS TC CUEFSTICN 2, PRESSURED 


4€ 





CN 


Ou 


a 
] 
PXPERIENCEL 
] 
| 
INEXPFRIENCED 
q 
| 
i 
| 
| 
| 
| 
| 
| 
| 
Fi SS 
S 
! ~ 
| \ 
: ~ 
SS 
5 fed ~~ <=. —— 
i SD at ae 
! —— 
: i 
| 
| 
| 
| 
A 
| 
| 
| 
i 
| 
| 
| 
] 
{ 
o> i 
| 
| 
| 
| 
| 
| 
j 
| 
] 
| 
| 
| 
Q@ ---------- De a a as Fe a ae a a a ane ; a2 
Phase 1 Phase 2 Phase 32 
Largure. 11 


MEAN RESECNSE LEVELS TC CUESTICN 4, IRRITATED 
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MEAN RESECNSE LEVELS TO QUESTICN 5, “ANXICUS 
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Mhase to the next during the conduct cf the experiment. it 
is readily apparent that this was not the case. While the 
mpvemwscUrrogate descriptors were deered caratle, in the 
eggregate, tc describe stress, they apparently were not 
completely successtul aS a subjective feasure. 

Tre ris« of self-inhipition is always run when asking 
sucj2cts to rate their Own perceptions, emotions, etc. [Ref. 
18: pp. 51-525] Self-image or self-esteem may prechibit a 
responaent from admitting of a higner level ct what he may 
veel to ce an urdesirable feeling cr trait. This may have 
been the case here. In the course of the experiment, the 
experimenter’s suojective assessment of the Subjects’ 
emotional states did not agree well with their questionnaire 
responses. Cn several cccasions, Slibyie cts lett the 
Experiment giving every eéeppeadrance of being agitated and 
exercised, paving answered with a 1 (i.e. not at all) to 
eil tive questicnus. 

moreover, although instructed to respond only in regard 
to )60©ach:)«€6hcinecividuel phase ot the experimrent, it appears 
likely that subjects responses may have been in the context 
cf their previous experiences in the experiment. Thus one 
sees the rise in most responses from the first (untimed) to 
mae slecend plrase of the experiment. During the “inal phase, 
Sueeeys Were eayeécting to be placed under a tighter time 


constraint (the desired apprehensicn effect). This may in 
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marie molaig the absence Of a risé€é in response levels for 
this last phase. 

The data gathered from the questionnaires was in the 
ordinal (1 to &) scale. Since an attempt was to be made to 
correlate these responses with recognition rates (interval 
aate) recourse was again made tc the ron-parametric 
Spearman's Rho procedure for correlating the ranks of both 
sets Oe dat a. Recoguiticn rates were tested against 
responses to all five questions for each phase of the 
experiment. Hesults generally showed no correlation. 

Oné questicn alone previded a réther consistent negative 
Serelation with recognition rates. For the inexperienced 
Subjects, question 2 (confused ) showed a strong negative 
correlation (rho< -@.4) tor all three phases of the 
experiment (credibie at an alpha less than cr equal tc @.1). 
meee would imply that as confusion level rose, recognition 
rate went dowr. It is interesting tc ncte that there was nc 
correlation fcurd petween this variatle and recognition for 
the experienced group. The only other question which showed 
some (negative) correletion was the fourth (“irritated ), 
but this relation was at most tenuous (¢.25>alpha>¢.1). Also 
of note is the fact that, after the initial pnase of the 
experiment, resronse levels tor the two grours parallel one 
another, in some instances very clcsely. This would appear 
further t0 corrovorate the hypothesis that differences 


cetweeén the two groups diminish rapidly. 
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VI. REMARKS 


If psychological stress has an effect on the voice, as 
is generally acknowledged, it is reasonable to expect it to 
have an effect on the success rates of users of voice input 
equipment. As discussed previously, ASR technology is of 
potentially great interest to the military plenner in the 
Comrand, Control, and Communications GOn Lert. This 
Preriminery inquiry has attemptea te shew a ccrrelaticn 
between stress ana recognition success with such equipnent. 
Séeverel areas cf ccnsiderétion suggest themselves. 

Me nas Deen seen, recoOgnriton rates declined when tne 
cpératcrs ot this ASR equipment were placed under tire 
press. AL alternative approach to €valuating the 
merrracoliity ci tris technology might be to assess vcice 
Memeus Other means of input under sirilar conditions. in 
tais study, subjects attempting to complete a neariy 
impossinle task (Fhase 3) nonetheless ranaged to maintain @ 
Pere ect recognition rate cr apprcezimately ninety percent. 
With manual input (e.g., typing), Each characer to be invut 
Maotesemuss ao OpvOrtunity fOr e€@rror:” BOW this might ve 
ettectea ty psychological stress iS open to speculation. 
Mien One considers that a sixteen character output strié 


Carn ve produced with one voice ccmmand, it may well be that 
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meee lintut becomes e@ven more desirable in a stressful 
environment. 

It is interesting to note how quickly the inexperienced 
sSutjects “caught up witb and paralleied the performance of 
their experienced counterparts. If this is indeed a 
generalizable rhenomenon, it would inrly that after some few 
training sessions with a reccgniZzer, the Gistinction 
vanishes. If so, faced with a potentiaily adverse situation 
a commander or watch officer need rot worry about this 
Experience-level in his Commana Post staffing. Voice input 
has also beé€n proposed for automated reservation and 
directory-assisteance schemes. Given the success rates for 
meemererLeucea users even under conditions calculated to 
induce stress, tnese applications appear no less teasible. 

Lastly, it is generally acknowledged that a rore 
cojective method for assessing psycholcgical stress is 
aesperetely neeaed. Any further work in this oerea shoulda 
find an alternative and hopefully more workable method of 
essessing stress ir subjects. It is submitted that sore 
relatively non-intrusive physiological measures of stress te 
considered. Several of these observable ard quvuantitviabdle 
inaicators are well docurenteéed in existing stress 
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*VOCABULARY LIST* 
RENE AK IE AK AK KE OE RENE OK I OK OK OK 


WORD 


ZERO 
ONE 
TWO 
THREE 


- FOUR 


FIVE 
SIX 
SEVEN 


- EIGHT 


NEGATIVE 


. TERMINATE 

- SEND MESSAGE 

. ANSWER MESSAGE 
- FORWARD MESSAGE 
- CINCPACELEET 

. THEIRDFLEET 

. BATTLE GROUP 


INFORMATION 


- RETURN 

» RALAR 

» VISUAL 

- ELACTRONIC 
- CONTACT 

- SIGETING 

- SOVIET 


cn 
CA 


4 WORD 

25. UNKNOWN 
Fear Oso lp Le 
2’. CERTAIN 
2@. CONFIDENCE 
29. LTAMAGE 

O@. ASSESSMENT 
1. REQUEST 
32. INSTRUCTIONS 
25. READINESS 
c4. INTENT 

55. ATTACK 

co. REPORT 

O?. RATHBURNE 
o@. FRCM 

29. COMMANDER 
4¢. SURFACE 
41. TIME 

42. ZULU 

43. PERIOD 

44. POSITION 
45. NUMBER 

46. BEARING 
47. DISTANCE 
48. UNDER 

49. ADVISE 
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cy. 
e 


Co Ey @oO> 


ae 
11. 
12. 
15. 


14. 


me . 
0 « 
me. 
Po « 
zo. 


eu 


APPENLIX B 
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FSCENARIO LISTING* 
DE BE I IK OK EA IK aK OR KO OK 


CRT OUTPUT 


SEND MESSAGE 
BATTLE GROUP 
COMMANDER 
RETURN 
INFORMATICN 
TEIRDELEET 
CINCPACELEERT 


RETURN 
FROM 
RATHBURNE SEND MSG TO: CV BATTLE GROUP COMMANDER 
INFO COPY TO: COMTHIRDELEET CINCPACELEET 
RETURN FROM: USS RATHBURNE 
POSITION REFORT NUMBER 1 
POSITON REALINESS LVL 3 
POSSIBLE ELECTRONIC SURFACE CONTACT 
REPORT BEARING:18@ DISTANCE 27 
CONFIDENCE LVL 3 
NUMBER REQUEST INSTRUCTIONS 
. CNE QUIT. 
RETURN 
READINESS 
THREE 
RETURN 
POSSIBLE 
ELECTRONIC 
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22. SURFACE 


Zo. 


24. 


25. 


41. 
42. 
45. 


44. 


CONTACT 
RETURN 
BEARING 


. ONE 


EIGHT 
ZERO 
DISTANCE 


- TWO 


SEVEN 


- RETURN 


CONFIDENCE 


THREE 


- RETURN 
- REQUEST 


INSTRUCTICNS 


. TERMINATE 


FORWARD MESSAGE 
SEVEN 

RETURN 
INFORMATION 
BATTLE GROUP 
COMMANDER 


- RETURN 


FORWARD MSG #:7 
INFO COPY TO: CV BATTLE GROUP COMMANDER 
FROM: USS RATHBURNE 


QUIT. 


cn 
cn 





46. FROM 

47. RATHEURNE 

48. TERMINATE 

49. ANSWER MESSAGE 

cg. TWO 

ol. SOUR 

o2. RETURN 
ANSWER MSG #: 24 

53. CONTACT CONTACT UNKNOWN POSSIBLE SOVIFT. 
(no carriege return in scenario) 

<4. UNKNOWN INTENT UNKNOWN 

ao. FOSSTELE GU1Ts 

Se. SOVIET 

mer PERIOD 

SE. INTENT 

o9. UNKNOWN 

E€S@. TERMINATE 

61. SEND MESSAGE 

62. BATILE GROUF 

63. COMMANDER 

€4. RETURN 

ES. INFCRMATICN 

66. THRIDILZEET 

ec. CINGCPACRIEEET 

E@. RETURN 


SE 
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69. CONTACT 
72. SIGHTING 
71. REPCRT 
72. NUMBER 
fom Olt 

74. RETURN 
ao 1 IME 

76. ONE 

77. SEVEN 
78. FOUR 

(3s. EIGHT 
EM. LULU 

eiw RETURN 
eae POSTTION 
G3. ONE 

G4. FIVE 

E5. SEVEN 
G6. TWO 

&7. LERO 

sc. RETURN 
EY. COMMANDER 
SO. ASSESSMENT 
wie PCselELs 
Ye. SOVIET 
Y5. SURFACE 


SEND MSG TO: CV FATTLE GROUP COMMANDER 
Werewecor, 10: CCMTHIRDFLEZT CINCPACKLEST 
CONTACT SIGHTING REFORT NUMBER €E 

TIME 174& ZULU 

POS 1 PGi Ler 20 

COMMANDER ASSESSMENT POSSIBLE SOWIET SURFACE. 
(no carriage return in scenaric) 
UNKNOWN 


QUIT. 
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94. PERIOD 


a. 


UNKNCWN 


96. TERMINATE 


97. ANSWER MESSAGE 
y&. THREE 

wo. HIGHT 

190. RETURN 

101. INFORKMATICN 
192. CINCFACFLEET 
192. RETURN 

104. FROM 

1@5. RATHEURNE 
19E€. RETURN 

107. UNKNOWN 
1@E. SURFACE 
129. CONTACT 
mee. PeRioy 

111. POSSIELE 
tec. SOV] EE 

112. RETURN 

114. UNKNOWN 
115. RADAR 

me. CONSEACT 

117. BEARING 
11E. Twe 


ANSWER MSG #: Zé 

INFO COPY TO: CINCPACELEET 

FROM: USS RATHEURNE 

UNKNOWN SURFACE CONTACT. POSSIBLE SOVIET 
UNKNOWN RADAR CONTACT BEARING: 235 
DISTANCE 14 

NEGATIVE VISUAL CONTACT. 

CONFIDENCE LVL ASSESSMENT 6. 

INTENT UNKNOWN. RECUEST ADVISZ 


QUIT. 
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fig. THREE 

12¢. FIVE 

121. RETURN 
lez. DISTANCE 
12d. ONE 

124. FOUR 

mes. RETURN 

1Z€. NEGATIVE 
Ber. VISUAL 

1z&. CONTACT 
foo. PERIOD 
15@. RETURN 
151. CONFIDENCE 
Mee. RSOESSYENT 
mS SIX 

154. PERICD 
ei. RETURN 

FOC. INTENT 

13%. UNKNCWN 
roc. PROD 
15%. REQUEST 
14@. ADVISE 
141. TERMINATE 
14<. SENT MESSAGE 





14<. 


144. 


BATTLE GRCUP 


COMMANDER 


- RETURN 


INFORMATION 


- THIREELERT 


- RETURN 


FROM 


- RATHEURNE 
- RETURN 


CONTACT 


» REPCRT 


NUMBER 


» old 
- RETURN 


CONTACT 


- SIGHTING 
7. RETURN 


CONTACT 
CERTAIN 
SOVIET 


. SURFACE 
- RETURN 
- BEARING 


TWO 


THREE 


SEND MSG TO: CV BATTLz: GROUP COMMANDER 
INFO COPY TO: COMTHIRIELEET 

FROM: USS RALHBURNE 

CCNTACT REFCRT NUMBER 6 

CONTACT SIGHTING 

CONTACT CERTAIN SOVIET SURFACE 
BEARING: 2é% 

DISTANCE 14 

INTENT UNKNOWN 


QUIT. 
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ec . 
1EsS ® 


ir’. 


aa 


Ge 


174. 


ac 


i7E oO 


SEVEN 
RETURN 
DISTANCE 
ONE 

FOUR 
RETURN 
INTENT 
UNKNCWN 
TERMINATE 


SEND MESSAGE 


. THIRDELEET 


- RETURN 


Fee. 


ie 7 . 


Hee. 


18g ® 


ioe. 


a1. 


INEFGRMATICN 


CINCFACELEST 


2. RETURN 


FROM 
RATHEURNE 
RETURN 
COMMANDER 
ASSESSMENT 
BATTLE GRCUP 
UNDER 

SOVIET 
ATTACK 


oN Dato LCs CCVMTHIRDEFLEST 

INEO COPY TC: CINCPACsLEFT 

FROM: USS RATHBURNE 

COMMANDER ASSESSMENT CV BATTLa GROUP 
(no carriage return in scenaric) 
UNDER SOVIaT ATTACK. DAMAG? LVL 

(no carriage return in scenario) 
UNENOWN. REQUEST ADVISE USS RATHBURNE 
(no carriage return in scenario) 
INTENT 


QUIT. 
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19z. PERIOD 
192. DAMAGE 
194. UNKNCWN 
19&. PERIOL 
19€. REQUEST 
197. ADVISE 
19&. RATHEURNE 
19S. INTENT 


eva. TERMINATE 
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END SCENARIC 
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APFPEINIIX C 


INSTRUCTIONS TC EXPERIMENT PARTICIPANTS *PHASE 1* 


me reuperirent you will be farticipating in simulates 
what might happen in a Shipboard command post. You will be 
using the vocatulary you have alreedy trained auring the 
Poors. session. 

Yeu will ve given a list ofr werds t0 speak to the 
machine: when recognized, they will come up on your screen. 
Certala words yroduce a multiple werd output, as you have 
alreacy seen. These are an attempt tec simulate message- 
handling utilities such as are fovnda on the ARPANET. 

Speak clearly and distinctly, tut don’t overenunciate. 
Ne provisicn has been mace to let you back up and correct 
mistakes, misreccgnitions, E€tc., $so you rust continue to sey 
the werd until it is réecegnized. If you miss a word and 
don’t cetch it, I will prompt you for the word you missed; 
pees Simtly try asain Om the wert I prompt you with. 
Pauses between werds may be short, tut they must be 
Gest lmet. 

Set your own pece,don t rush but don’t linger. You are 
not competing against anyone (including yourself) for time 
Or recognition, so don’t be nervous. No grades are »deing 
Pawen™ Our here. Once you start, wewever, please continue to 
the erd. 

I will be glea to answer any aquvestions you may have 
ebewut tne conduct of this fhese ot the experiment. Any 
questions arout the purpose and cutcere I will te glad te 
gqiscuss at great length once the actual experimentation 
poasée is throvugn. 

Thanks again for your help. 
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APPENLIX [ 


INSTRUCTIONS TO EXPERIMENT PARTICIPANTS [een kh a 


This is Phase < of the experinent. In this phase you 
wmeleeparticipete in @ Command Post scenario very similiar in 
cOntEent and length to tne first scenario you were given. 

Ine west Significant ditterence in this rhase is the 
time factor. In FPhase ¢€ you will be allotted only 2/2 of the 
meme yOu Originaily took to complete the entire scenario. In 
meres Oo ay NoT De able tO complete the Entire scé€nearic. 
meme to te “eMphasized that your primary objective is te 
complete es much of the scé€nario &a&s you possibly can, as 
Seeeraveliy as possible. In this conmand post situation, tae 
Meermeees yeu wili be handling are cf an urgent nature, and 
your primary mrotivetion is to get as mary of ther corpletea 
Seeeeossitle. {cu are being scored fcr toth ré€écognition rete 
and the percentage of the scé€naric you ccmplete. Any farts 
BeeemoomnOt COP- Fiete will count egainst your overall score, 
Mee rturately.... 

wioenae tae  Experimrerst, 1 will give you frequent 
rerincers of the time yov nave remaining at $@ second 
intervals. The tire fi announce will be in minutes and 
s@€ccrnds remeining. The timer will alsc furnish yeu with a 
running indication of tire remaining. 

Again, attenrpt to speak clearly and distinctly. No 
provision has deen madé to back up and correct mistaxes cr 
misrecognitions, so you must repeat the word or prrese until 
it is correctly recognizea. It you miss a word and aon’t 
Perecmeiv, i*Wlll prcempt you for the werd ycu rissed: please 
try egéin on tne word I prompt you with. 

Peceme f£e-crraasize here that the shortened time- 
@illcwance is reant to represent the urgency of the sitvaticn 
Meecre Conmerd FOSt, and that your frincipal goal is to 
Peelise 45 7UGn Of Lhe Scendrio as possible. 

Thanks again Yor your help. 
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PoeruClIONS TC EXPERIMENT PARTICIPANTS “y, 


Peon: Ss FhRase 3S Of the experiment. In tkis phase vou 
WOLil verticipate in a Comrand Post scenario very sirilar in 
meets and leneth tc the first scernaric ycu were given. 

The most significant aifference in this these is the 
time tactor. In Phese 3 you will be allotted only 1/2 otf the 
meme you criginaliy tcok tc ccmplete tke entire scenario. In 
Beet, ou «6omay net be able tO complete the Entire scenearic. 
memeeeebO Le Cf ~;aasized tihat ycur fErinary otjective is to 
@emmeeebe aS ftch of the scénaria as yeu ocesitiy cen, as 

Gemmecately aS -essible. in this comménd pest sitretion, the 
Meee es you will be handling are cf an urgent nature, ind 
memes irany mctivaticn is to set at many cf them comrndleted 
Mma ble. “CU are being scored for both recognition rete 
meow TET CeNntesze cf the scenario you cemrleté. «any farts 
fommeeenet Com- plete will ccunt age@inst your cverall ¢éccre, 
Meme rturetely.... 

Pyne toe  eExererinéct, 1 will give your fPrequesat 
Betmineers cz the time yrev have remaining at 7? seccnd 
inté€rvels. The time [I announce will be in minvtes end 
eemerds rercainige. The tirer will also furni¢ch you with a 
Diniee ifdiceticn of time renainsire. 

Meein, attempt tc speek clearly and distine 
mameeeeron )6[6hhasS.|.l6CUODE en race to back ut and correct ris 
Meer eccepitions, sc yer must repeat the word or pnra 
Meewys correctly récognized. If you miss € wera é 
Geuchmay, | will trofrpt you fer the werd you. rissed: 
Wy a@fdin con the werd [ trompt yeu with. 

Let re re-errhasize here thet the ¢hortened tire- 
Peelovemecminomiectit tC Tezrese€nt the urgency of the situeaticn 
Mietmemcotmmard rOSt, and that ycur principal -cal is te 
finish es much of the scenario 2s rossitle. 

Thenks again for your helt. 
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APPENDIX G 


QUFSTIONNATRE 

ME NE HE AE IK HE IK KE IS IK AE HIE AN IIE AK KC ARE OK IES IK AKC I ONE IEE IKE I KE IIE KE IC AK AK OK A OK BIE ON KE A IIE OE ARE KC NIE OK OIE OK EE A A aK ON IIE ORK NE OK NE OE OK OK aE KE OK IK 
IY Bites 6 we ee ew 
[Ube 8 8 ere ae 
130-0) RS 5 0 8 5 


Please answer the following questions concerning your 
feelings dvring the phase of the exreriment yov have jvst 
completed. These questions pertain ONLY to this vohese. 

Peepewe: LHGNTESTCESe which best describes your feelings. 
Mme scale is: 


1 = NCT AT ALL 
5 = MCDERATSLY OR SOMEVEAT 
») = VERY MUCH SC 


or 


Resronses < and 4 are the midpcints between the atcve. 


QUESTION: (Circle cne “cr each questicn) 


Poteene tnlsepaase oOo: the EGxeerirent, [| frelit: 


pet-dt ail Regemea,ely very ruch so 
1. nervous u ye ) 4 = 
e. ccnhused 1 2 fe 4 5, 
eo. pressured at < S G = 
4. irritated i 2 o + 2 
S. anxious 1 < s) 4 2 


SeREXPLRASE! Don’t discuss your experience or answers with anyone. 
WE AK IK AE KK KK 
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